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Abstract.  Properties  of  the  difference  of  two  sums  containing  products  of  binomial  coefficients 
and  their  logarithms  which  arise  in  the  application  of  Shannon’s  information  theory  to  a  certain  class 
of  covert  channels  are  deduced.  Some  allied  consequences  of  the  latter  are  also  recorded. 
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1.  Introduction.  Traffic  analysis  in  anonymizing  network  configurations  can  be 
used  to  open  a  covert  communication  channel.  Recently,  Moskowitz  et  al.  [2]  have 
developed  a  mathematical  model  (whose  salient  feature  is  given  by  equation  (1.1) 
below)  that  describes  the  situation  of  oneway  messages  passing  from  private  Enclavei 
to  private  Enclave2  in  which  each  communication  is  encrypted  and  passes  through 
exit  and  entry  mix  firewalls.  Furthermore,  there  are  n  +  1  senders  in  Enclavei,  and 
one  of  them  called  Alice  is  malicious.  The  other  n  clueless  transmitters  are  benign. 
Every  sender  may  send  at  most  one  message  per  unit  time  t  to  Enclave2.  All  messages 
from  Enclavei  to  Enclave2  pass  through  a  public  line  that  is  subject  to  eavesdropping 
by  an  eavesdropper  called  Eve  who  knows  the  value  of  n.  The  only  action  Eve  can 
take  is  to  count  the  number  of  messages  per  t  going  from  Enclavei  to  Enclave2.  The 
n  clueless  transmitters  all  send  their  messages  per  t  as  independently  and  identically 
distributed  Bernoulli  random  variables  with  parameter  q .  Alice  acts  independently 
(through  ignorance  of  the  n  clueless  senders)  when  deciding  to  send  a  message.  Thus, 
Alice  by  sending  or  not  sending  a  message  affects  the  number  of  messages  that  Eve 
counts.  This  in  brief  is  the  covert  channel. 

A  normalizing  noise  term  S  ( n )  is  defined  corresponding  to  the  degree  of  anonymity 
afforded  by  the  n  clueless  senders  transmitting  as  fair  coins  ( q  —  1/2)  which  is  the 
situation  when  maximal  anonymity  occurs.  For  n  —  1,  2,  3, . . .  S(n)  is  shown  in  [2]  to 
be  given  by 


1  n 

»(»>  =  „£ 


fe=0  L 


n  + 1 
k 


In 


71  +  1 

k 


(1.1) 


and  by  employing  Shannon’s  information  theory  the  capacity  is  given  by  1  —  S(n) /  In  2. 
Moreover,  an  important  property  of  this  model  is  that  the  capacity  should  decrease 
monotonically  to  zero  with  increasing  n. 

For  brevity  in  the  sequel  we  define  T(n)  =  2 nS(n).  The  expression  for  T(n)  is  of 
interest  in  its  own  right,  since  it  is  the  difference  of  two  divergent  sums  that  contain 
products  of  binomial  coefficients  and  their  logarithms.  Moreover,  these  types  of  sums 
appear  not  to  be  readily  found  in  the  mathematical  literature. 

In  the  present  investigation  we  shall  obtain  in  section  2  a  simpler  algebraic  rep¬ 
resentation  for  T(n)  which  contains  the  sum  £(*)  In (k  +  1)  that  is  similar,  for 
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example,  to  a  particular  sum  involved  in  a  representation  for  lnT(x  A  1)  deduced  by 
Stirling  for  x  >  —  1  (see  [1,  equation  (5.47)]).  We  shall  also  derive  two  integral  repre¬ 
sentations  and  two  representations  involving  integrals  for  S(n).  Then  in  section  3  we 
give  a  detailed  proof  that  S(n)  is  monotonically  increasing  with  increasing  n.  This 
property  of  S(n)  alluded  to  above  was  verified  numerically  in  [2]  for  n  <  7750.  Finally, 
in  section  4,  we  show  that  S(n)  -A  In  2  as  n  -A  oo.  We  record  some  consequences  of 
the  latter  as  well. 

2.  Reduction  of  S(n)  to  a  simpler  sum.  Recall  that  T(n)  —  2 nS(n)  where 
S(n)  is  given  by  equation  (1.1).  We  shall  show  below  that 


T(n)  =  2"  In (n  +  1)  -  £  (  £  )  In (k  +  1) 

k= 0  '  ' 


and  that  S(n)  may  be  written  elegantly  as 


S{n) 


In 


n  +  1\ 

k  +  l)  ' 


To  prove  the  latter  we  define 


(2.1) 


(2.2) 


where  the  binomial  coefficient  ^  ^  j  —  nl / kl(n  —  k)\  which  we  agree  vanishes  if  k  >  n 
or  if  k  <  0.  Thus 

a(n)=lnn!^(  £  )  ~  £  (  \  )lnfc!-^(  \  )  ln(n  -  k)\  .  (2.3) 

k= 0  ^  '  k= 0  ^  '  k= 0  ^  ' 

The  first  sum  equals  2n.  By  noting  that 

(!)=(„-*) 

and  reversing  the  order  of  summation  (i.e.  by  letting  k  ha  n  —  k)  in  the  third  sum, 
we  see  that  the  second  and  third  sums  in  equation  (2.3)  are  equal  so  that 


a(n)  —  2n  Inn!  — 


ln/c! 


(2.5a) 


and  so 


n+ 1 


k= 0 


x(n  A  1)  =  2n+1  ln(n  +  1)!  —  2  |  U  +  ^  )  Inkl  .  (2.5b) 


From  equation  (1.1)  and  the  definitions  of  T(n)  and  a(n)  it  is  evident  that 


T(n)  —  -a(n  A  1)  —  a(n) 
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and  so  by  using  equations  (2.5)  we  have 

n+ 1 


T(n)  =2"ln(n  +  l)  +  ^ 
Now  observing  that 


k= 0  L 


n  \  (  n  +  1 


lnfc!  . 


n  +  1 
k 


equation  (2.6)  gives 


T(n)  =  2»ln(n  +  l)  +  £l  £  )  !**!-£(  *  _  1 


k= 0 


n  \  (  n 

k  /  k  —  1 


n+l 


/c=l 


ln/c!  . 


(2.6) 


(2.7) 


Finally,  since 


n+l 

£ 

k=l 


n 

k  —  1 


ln/c!  =  ^ 


k= 0 


In  (k  +  1)! 


we  obtain  equation  (2.1). 
Thus  also 


S{n)  =  ln(n  +  l)-^r£^)  M*  +  !) 


(2.8) 


which  shows  that  —S(n)  is  the  difference  of  a  divergent  weighted  sum  of  logarithms 


ln(fc  + 1)  (since  ^  2 


k= 0 


k 


1)  and  the  montonically  increasing  logarithm  ln(n  + 


1).  This  observation  brings  to  mind  and  is  analogous  to  one  of  the  many  formulations 
for  Euler’s  constant  7  (cf.  e.g.  [1,  equation  (6.65)]  )  which  is  the  limiting  value 

n 

as  n  00  of  the  much  simpler  difference  of  the  divergent  harmonic  series  ^  1  jk 

k= 1 

and  ln(n  +  1).  (However,  we  show  in  section  4  that  S(n)  -+  In 2  as  n  -+  00.)  We 
have  already  noted  that  series  of  the  type  appearing  in  equation  (2.1)  appear  in  the 
literature  in  other  contexts. 

We  conclude  this  section  by  deriving  four  integral  representations  for  S(n).  We 
start  with  (see  [3,  section  2.6.17.,  equation  (1)]  ) 


In 


n  +  l 


xn-xk 


dx 

In#  ’ 


(2.9) 


where  n  >  —  1  and  k  >  —  1.  Multiplying  both  sides  of  equation  (2.9)  by  the  binomial 
coefficient  f  ^  ^  and  summing  over  the  index  k  gives 


(l+^n 


dx 

In# 
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Dividing  each  side  of  the  latter  equation  by  2n  and  noting  equation  (2.2)  we  deduce 
for  n  —  1,  2, 3  . . . 


1  +  x  \  n"  dx 
2  )  _  Inx 


(2.10a) 


Now  making  the  transformation  x  —  e  1  in  the  latter  integral  yields 


S(n)  =  f 
Jo 


0  —  {n+l)t 


1  +  el 


t\  n 


dt 

t 


(2.10b) 


However,  letting  n  —  0  in  equation  (2.9)  we  may  start  with 


Multiplying  the  latter  equation  by 


n 

k 


and  summing  over  k  now  gives 


£(n*)Hk+i)=l> 


+  x)n 


2n] 


dx 

Inx 


which  upon  dividing  by  2n  and  noting  equation  (2.8)  yields 


S(n)  =  ln(n  + 


dx 

In# 


(2.11a) 


Upon  making  the  transformation  x  —  e  *  in  the  integral  this  result  can  also  be  written 
as 


S(n)  =  ln(n  + 


(2.11b) 


3.  Monotonicity  and  boundedness  of  S(n).  We  now  prove  that  S(n)  is  in¬ 
creasing  with  increasing  n  >  1,  i.e.  S(n  +  1)  >  S(n)  for  n  —  1,  2,  3, _ 

First  we  observe  that  when  the  positive  integer  n  >  1  is  replaced  by  the  real 
variable  £  >  0  in  equations  (2.10)  and  (2.11),  then  the  latter  provide  continuous  and 
differentiable  analogues  of  the  discrete  sum  S(n)  given  by  equation  (1.1).  Thus,  for 
example,  we  have  from  equation  (2.11a)  for  t  >  0 


S(t)  —  ln(l  +  £)+/* 

Jo 


1  - 


1  +  x 


dx 

Inx 


Now  differentiating  S(t)  with  respect  to  t  gives 


_  _L _ f1  /1  +  x 

dt  1  +  t  Jo  y  2 


£  r 


ln(l  +  x)  —  In  2 
Inx 


dx  , 


(3.1) 


where  it  is  easy  to  see  that  on  the  closed  interval  0  <  x  <  1 
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Thus  obviously 


I  ^ 


ln(l  +  x)  —  In  2 


Inx 


dx  < 


dx  . 


Since 


¥^sy+x),m = ^ 


1  -  1 

< 


+  t  1  +  t 


it  is  evident  that 


ar 


t  r 


ln(l  +  x)  —  In  2 


lux 


dx  < 


1  +  t 


Finally,  from  equation  (3.1)  we  have  dS/dt  >  0  and  so  S(t)  is  a  strictly  increasing 
function  of  t  >  0  thus  proving  our  assertion  for  S(n). 

We  conclude  this  section  by  showing  for  n  >  1  that 


S(n)  <  2(1  —  2_n_1)  <2  . 


(3.2) 


Assuming  the  latter,  since  S(n)  is  monotonically  increasing  and  bounded  we  may 
define 


/x  =  lim  S(n)  , 

n— voo 


where  from  inequalities  (3.2)  we  must  have  0  <  fi  <  2. 

To  show  inequalities  (3.2),  upon  observing  that 

.  n  +  1\  n  +  1  ,  N 

In  [  -r-— r  )  <  t— r r  (fe  =  0, 1, . . . ,  rc)  , 


,*  +  1/  fe  +  1 

we  have  from  equation  (2.2) 


Q(  \  /  n  +  1  ^  n  ^  1 

5(n)  <  -or-  E 


2n  ^  V  k  J  k  +  1  * 

£;=0  V  7 


Since  (see  e.g.[3,  section  4.2.2.,  equation  (42)]  ) 

1  1 


E 

k= 0 


k  J  k  +  1  n  + 


-(2”+1  -  1)  , 


it  is  evident  that  S(n)  <  2  —  2  n  and  we  are  done. 

4.  The  limiting  value  of  S(n)  as  n  -A  oo.  From  equation  (2.2)  we  may  write 


Letting  k  i-A  n  —  k  and  using  equation  (2.4)  in  this  result  then  yields 


(4.1) 
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Since  for  0  <  z  <  1 


P=  1 


setting  z  =  k/(n  +  l)  we  have  from  equations  (4.1)  and  (4.2) 


2"  V  k  )  ^  p\n  +  1 

*=o  v  7  p= 1  ^  ' 


& 


Formally  interchanging  the  order  of  summation  then  gives 


(4.2) 


S(n)  =  2.  V  -  1  V  (  "  )  F 

v  ’  2n  ^  p  (n  +  l)P  ^  \  k 

p= 1  v  7  ^=1 


where  for  integers  p  >  0 


\  k  k 

-I) 


£=0 


(4.3) 


,  (4.4) 


and  it  is  understood  that  the  latter  second  term  vanishes  when  p  —  1.  Equation  (4.4) 
is  derived  ab  initio  by  Schwatt  (cf.  [4,  p.  84,  equation  (34)]  )  where  here  a  misprint 
is  now  corrected. 

Since  (;)=„!«„-,)!  we  have  from  equations  (4.3)  and  (4.4) 


c(  \  _  ST  (1/2)P  Mp{n)  I  (?P~i(n) 

{>  ^  p  (n  +  l)P  ^p  (n  +  l)P  ’ 

p=  1  x  7  p=  1  x  7 


where  we  have  defined 


Mp{n) 


n\ 

(n  —  p)\ 


and 


p- 1 

Qp~i(n)  = 

k= 1 


-i  \  k  k 


£=0 


(P 


(4.5) 


(4.6) 


(4.7) 


Observing  that  the  first  and  second  p-summations  in  equation  (4.5)  will  terminate 
respectively  when  p  >  n  and  p  —  1  >  n,  this  result  can  only  be  valid  as  a  divergent 
asymptotic  expansion  for  S(n)  about  n  —  oo. 

However,  it  is  easily  seen  from  equation  (4.6)  that 


Mp(n)  —  n(n  —  1)  •  •  •  (n  —  (p  —  1)) 

and  so  Mp(n)  is  a  monic  polynomial  in  n  of  degree  p .  Thus  for  each  p  >  0  it  is  evident 
that 


Mp{n) 

(n  +  1)p 


nj 


=  1  +  0 


(n  -+  oo)  . 


(4.8a) 


SIAM  Review  —  to  appear 


7 


Moreover,  from  equation  (4.7)  it  is  also  easily  seen  that  Qp-i(n)  is  a  polynomial  in 
n  of  degree  p  —  1.  Let  cp- 1  be  the  coefficient  of  nv~x  in  Qp-i(n).  Then  also  from 
equation  (4.7)  we  have 


(—1/2  r1  ^ 

’  £=0 


P~  1 


£p  . 


Schwatt  [4,  p.  101,  equation  (196)]  has  shown  for  p  >  1  that 

P-i 


so  that 


Thus  we  have 


D-W  P  £  1  )^  =  (-l)p-1i(p-l)p! 
^=0  '  ' 


'lV 

Cp-l  =  1 2J  p(p-  ^  ■ 


Qp-i(n)  _  fl 


2/  1)0,„ 


(n  — »■  00) 


(n  +  1)p 

and  by  using  equations  (4.8)  we  have  from  equation  (4.5)  the  asymptotic  result 


(4.8b) 


S(n)  = 


1  +  0 


J  P=1 


n/  •<— '  V  2 

P=1 


Recalling  equation  (4.2)  the  first  sum  in  equation  (4.9)  equals  In  2  and  it  is  easily 
shown  that  the  second  sum  reduces  to  unity  so  that  we  can  now  write  equation  (4.9) 
as 


S{n) 


1  +  0  (  - 

n 


In  2  +  O 


1 

n 


(n  oo)  . 


Finally,  since  we  have  already  shown  in  section  3  that  lim  S(n)  exists  as  a  positive 

n— voo 

number  p  <  2,  it  is  evident  from  the  latter  result  that  p  —  In  2. 

We  end  by  recording  two  interesting  corollaries  that  are  obtained  immediately 
from  equations  (2.10),  namely 


lim 

n— voo 


1  +  X 
2 


dx 

In# 


=  In  2 


and 


lim 

n— voo 


f 


e 


(n+  l)x 


1  +  ea 


dx  ,  ^ 
—  =  In  2 

x 


5.  Conclusions.  We  have  discussed  how  an  important  application  in  anonymity 
and  covert  channels  leads  to  the  problem  of  deducing  properties  of  the  difference  of 
sums  containing  products  of  binomial  coefficients  and  their  logarithms.  Intuitively,  the 
capacity  of  the  covert  channel  should  decrease  monotonically  to  zero  as  the  number 
of  transmitters  increases,  and  the  analysis  provided  herein  proves  this. 
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